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SYSTEMS AND METHODS FOR THREE-DIMENSIONAL MODELING 

Cross-Reference to Related Applications 
[0001] This application claims the benefit of U.S. provisional patent application Serial 

No. 60/260,278, filed January 8, 2001, which application is incorporated herein in its entirety by 
reference. 

Field of the Invention 

[0002] This invention relates generally to methods and systems for modeling objects in 

three-dimensional space. More particularly, the invention relates to methods and systems for 
modeling a virtual object in a computer environment that undergoes transformations as a 
consequence of a user interacting with the virtual object. 

Background of the Invention 
[0003] Software tools for three-dimensional modeling strongly couple the geometry 

representation with the allowable editing methods. For example, a voxel representation is 
limited to direct edits to the yoxel grid, such as a Boolean addition, subtraction, or averaging of 
values. Likewise, a surface-triangles-based representation limits editing to modifications to 
various displacements of the triangle vertices. As a result, modeling capabilities which the end 
user can employ are limited to those tools that lend themselves to editing of the primary 
geometry representation. Editing performed on a primary geometry representation imposes 
limitations on the operations that can be performed, and certain operations can be so difficult to 
perform that they are virtually impossible without unacceptably excessive computational effort. 
[0004] Some of the problems that exist in methods available in the prior art include the 

following negative features. In volumetric models, it is difficult if not impossible to make 
changes such as bending, stretching, and other gross modifications without loss of significant 
model details. Conversely, although surface-based methods more adequately support stretching, 
tugging, and other "rubber sheet" like operations, they lack the editing capabilities which 
volumetric representations provide, such as voxel-value-averaging and automated handling of 
self-intersections and overlaps. An important negative; consequence of these existing methods is 
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that careful planning of model creation is required, with little or with no option to make 
appreciable changes once work is underway. I 



Summary of the Invention 



[0005] The methods and systems of the invention provide highly flexible editing of 

models in three-dimensional space. In one embodiment, the invention provides a method of 
modifying an object or a portion of an object by using an alternative subset representation for 



editing purposes. Using the results of editing this alternative subset representation, the original 
geometry is modified to substantially represent the edits made to the altemative representation. 
This method allows users to move transparently between editing in various representations while 
maintaining a cohesive base representation. For example, a portion of a voxel-based model can 
be transformed into a surface-triangles-based model. The surface -triangles-based model can be 
modified using triangle-based modification methods and the voxel-based model thereafter 
updated to reflect the changes. In another exemplary embodiment, a portion of a Non-Uniform 
Rational B-Spiine (NURBS)-based model can be transformed into a voxel-based model. The 
voxel-based model can be modified using a voxel value averaging modification method and the 
NURBS-based model thereafter updated to reflect the changes. In a further exemplary 
embodiment, a portion of a voxel-based model can be transformed into a NURBS-based model, 
the NURBS-based model can be modified using control vertex modification methods and the 
voxel-based model thereafter updated to reflect the changes. 

[0006] In one aspect, the invention relates to a method of modifying a virtual object 

stored within a computer. The method comprises the steps of representing a virtual object as a 
volumetric model; converting a subset of the volumetric model into an altemative representation; 
determining a response of the altemative representation to a stimulus; and modifying the 
volumetric representation so as to substantially represent the response of the altemative 
representation to the stimulus. 

[0007] In some embodiments, determining a response of the altemative representation to 

a stimulus comprises determining a response of the altemative representation to a first stimulus 
and further determining a response of the altemative representation to a second succeeding 
stimulus. In some embodiments, modifying the volumetric representation comprises a change in 
shape of the volumetric representation. In some embodiments, modifying the volumetric 
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representation comprises converting the response of the alternative representation to the stimulus 
into a response of the volumetric representation to the stimulus. 

[0008] In some embodiments, the subset of the volimietric model is the entire volumetric 

model. In some embodiments, the subset of the volumetric model is a portion of the volumetric 
5 model. In some embodiments, the volumetric model comprises voxels. In some embodiments, 
the volumetric model comprises values spaced in a three-dimensional grid. 
[0009] In some embodiments, the alternative representation comprises a surface 

representation. In some embodiments, the ahemative representation comprises a set-of-triangles 
representation. 

10 [0010] In some embodiments, the stimulus comprises a weighted displacement function 

defined on vertices of the set-of-triangles representation. . 
\t, [0011] In some embodiments, the alternative representation comprises a selected one of a 

Q polygon set, a bezier surface, a b-spline surface, a procedural surface, and a NURBS 
s..^ representation. In some embodiments, the alternative representation comprises an alternative 
^ J 5 voxel representation. 

19 [0012] In some embodiments, the stimulus is a stimulus from a user using a haptic 

interface. In some embodiments, the haptic interface is a force feedback interface. In some 
embodiments, the haptic interface has at least three degrees of force feedback. 

ep [0013] In some embodiments, the method further comprises the step of displaying the 

Q 

1^0 virtual object on a computer display. 

[0014] In some embodiments, the volumetric representation and the alternative 

representation comprise representations having different numbers of dimensions. 
[0015] In some embodiments, the applied stimulus comprises at least one of a 

displacement function, a smoothing function, a warping function, a volumetric interference, an 

25 areal interference, a result of a simulation, a control point modification, a data re-fitting, and a 
force. In some embodiments, the applied stimulus is applied to the object in real time. 
[0016] In some embodiments, the method further comprises the steps of transforming the 

alternative representation into a third representation; modifying the third representation in 
response to an applied stimulus; and transforming the modified third representation to a modified 

30 volumetric representation. In some embodiments, transforming the modified third representation 
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to the modified volumetric representation comprises generating an intermediate modified 
representation. 

[0017] In some embodiments, the stimulus comprises a user motion in the at least three- 

dimensional space. 

5 [0018] In some embodiments, the method further comprises applying a feedback force to 

a user, the feedback force being generally consistent with a geometric shape of a modified virtual 
object. 

[0019] In another aspect, the invention relates to a method of modifying a volumetric 

representation of an object. The method comprises the steps of transforming at least a portion of 
10 the volumetric representation into a polygonal set representation; modifying the polygonal set 
representation; and modifying the volumetric representation to substantially represent the 
modification made to the polygonal set representation. 

Q 

Q [0020] In some embodiments, the modification comprises a selected one of a 

displacement function, a smoothing function, a warping function, a volumetric interference, an 
areal interference, a result of a simulation, a control point modification, a data re-fitting, and a 

15 force. 

|4, [0021] In yet another aspect, the invention features a method of modifying a volumetric 

1^ representation of an object. The method comprises the steps of transforming at least a portion of 
^5 the volumetric representation into a surface-based representation; modifying the surface-based 
|,^0 representation; and modifying the volumetric representation to substantially represent the 
modification made to the surface based representation. 

[0022] In another aspect, the invention relates to a system for modifying a virtual object 

stored within a computer. The system comprises a representation module that represents a virtual 
object as a volumetric model; a conversion module that converts a subset of the volumetric 
25 model into an altemative representation; an analytic module that determines a response of the 
alternative representation to a stimulus; and a modification module that modifies the volumetric 
representation so as to substantially represent the response of the altemative representation to the 
stimulus. 

[0023] In some embodiments, the analytic module that determines a response of the 

30 altemative representation to a stimulus comprises an analytic module that determines a response 
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of the alternative representation to a first stimulus and further determines a response of the 
alternative representation to a second succeeding stimulus. In some embodiments, the 
modification module that modifies the volumetric representation comprises a modification 
module that changes a shape of the volumetric representation. In some embodiments, the 
5 modification module that modifies the volumetric representation comprises a modification 

module that converts the response of the alternative representation to the stimulus into a response 
of the volumetric representation to the stimulus. 

[0024] In some embodiments, the subset of the volumetric model is the entire volumetric 

model. In some embodiments, the subset of the volumetric model is a portion of the volumetric 
10 model. In some embodiments, the volumetric model comprises voxels. In some embodiments, 
the volumetric model comprises values spaced in a three-dimensional grid. 

!•* [0025] In some embodiments, the alternative representation comprises a surface 

P 

p representation. In some embodiments, the alternative representation comprises a set-of-triangles 

1^ - " 

I . . representation. In some embodiments, the stimulus comprises a weighted displacement fimction 

H5 defined on vertices of the set-of-triangles representation. In some embodiments, the alternative 

ajsa 

representation comprises a selected one of a polygon set, a bezier surface, a b-spline surface, a 
procedural surface, and a NURBS representation. In some embodiments, the alternative 

?y representation comprises an altemative voxel representation. 

I* 

[0026] In some embodiments, the stimulus is a stimulus firom a user using a haptic 

jjo interface. In some embodiments, the haptic interface is a force feedback interface. In some 
embodiments, the haptic interface has at least three degrees of force feedback. 
[0027] In some embodiments, the system fiirther comprises a display module that 

displays the virtual object on a computer display. 

[0028] In some embodiments, the volumetric representation and the altemative 

25 representation comprise representations having different numbers of dimensions. In some 
embodiments, the applied stimulus comprises at least one of a displacement fimction, a 
smoothing fimction, a warping fimction, a volumetric interference, an areal interference, a result 
of a simulation, a control point modification, a data re-fitting, and a force. In some embodiments, 
the applied stimulus is applied to the object in real time. 
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[0029] In some embodiments, the system flirthier comprises a second transforaiation 

module that transforais the alternative representation into a third representation; a third 
modification module that modifies the third representation in response to an applied stimulus; 
and a third transformation module that transforms the modified third representation to a modified 
5 volumetric representation. 

[0030] In some embodiments, the third transformation module that transforms the 

modified third representation to the modified volumetric representation comprises a 
transformation module that generates an intermediate modified representation. 
[0031] In some embodiments, at least two of the first, second and third modification 

10 modules are the same module. In some embodiments, at least two of the first, second and third 
transformation modules are the same module, 

J* [0032] In some embodiments, the stimulus comprises a user motion in the at least three- 

Q dimensional space. 

^4 [0033] In some embodiments, the system further comprises a force feedback module that 

^$5 applies a feedback force to a user, the feedback force being generally consistent with a geometric 

shape of a modified virtual object. 
|4 [0034] In another aspect, the invention features a system of modifying a volumetric 

1^ representation of an object. The system comprises a transformation module that transforms at 
^1 least a portion of the volumetric representation into a polygonal set representation; a first 
|l0 modification module that modifies the polygonal set representation; and a second modification 

module that modifies the volumetric representation to substantially represent the modification 

made to the polygonal set representation. 

[0035] In some embodiments, a selected one of the modification of the polygonal set 

representation and the modification of the volumetric representation comprises a selected one of 
25 a displacement function, a smoothing function, a warping function, a volumetric interference, an 
areal interference, a result of a simulation, a control point modification, a data re-fitting, and a 
force. 

[0036] In yet another aspect, the invention relates to a system of modifying a volumetric 

representation of an object. The system comprises a transformation module that transforms at 
30 least a portion of the volumetric representation into a surface-based representation; a first 
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modification module that modifies the surface-based representation; and a second modification 
module that modifies the volumetric representation to substantially represent the modification 
made to the surface based representation. 

[0037] The foregoing and other objects, aspects, features, and advantages of the invention 

will become more apparent from the following description and from the claims. 
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Brief Description of the Drawings 
[0038] The objects and features of the invention can be better understood with reference 

to the drawings described below, and the claims. The drawings are not necessarily to scale, 
emphasis instead generally being placed upon illustrating the principles of the invention. In the 
5 drawings, like numerals are used to indicate like parts throughout the various views. 

[0039] Figs. lA-lC are images illustrating various three-dimensional objects having 

surface details; 

[0040] Figs. 2A-2B are images showing a spherical object represented in a three- 

dimensional volume before (Fig. 2A) and after (Fig. 23) an illustrative deformation, according to 
1 0 principles of the invention; 

[0041] Figs. 3 A-3C are drawings that illustrate an embodiment of the invention relating 

to the selecting of an area to deform or warp (Fig. 3 A), the selection of a location at which to 

Q 

Q apply the deformation or warp (Fig. 3B), and the application of a "pulling" force to the selected 
!^ area at the selected location (Fig. 3C); 

^ J 5 [0042] Fig. 4 is a drawing that illustrates different "fallofP' levels in images "a" and "b," 

CO according to principles of the invention; 

? 

[0043] Fig. 5 is a drawinjg that illustrates the result of a directional tugging force applied 

to a selected area, according to principles of the invention; 

[0044] Fig. 6 is a drawing that illustrates the result of applying multiple modifications to 

1^0 a selected area, according to principles of the invention; 

[0045] Fig. 7A is a flowchart showing schematically a sequence of operations during 

model editing according to one embodiment of the invention; 

[0046] Fig. 7B is a flowchart showing schematically the organization of a system for 

three-dimensional modeling that comprises computer modules, according to one embodiment of 
25 the invention; 

[0047] Fig. 8 is a schematic diagram showing illustrative transformations of a modified 

portion of a model from canonical representation to intermediate representation and back, with 
editing done on the intermediate representation, according to principles of the invention; 
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[0048] Fig. 9 is a diagram showing an embodiment of an illustrative rasterization process 

based on surface crossings for conversion of a model from surface representation to volumetric 
representation according to principles of the invention; 

[0049] Fig. 10 is an image of an embodiment of a menu in a computer user interface that 

5 provides access to modeling features according to systems and methods of the invention; 
[0050] Fig. 1 1 is an image of an embodiment of a control panel that allows a user to 

control the operation of modeling features according to systems and methods of the invention; 
[0051] Fig. 12 is a graph that illustrates an embodiment of a single valued-distribution 

function f((D) that maps the interval [0,1] as a 1-to-l mapping onto the interval [0,1], according to 
10 principles of the invention; and 

[0052] Figs. 13A-13B are graphs that illustrate various relationships between a source 

J_ point S and a point Po that the point S can influence, according to principles of the invention. 

13 . : ;• 

P Detailed Description 

|«? ^ >; . 

"^r^ [0053] The invention is described with respect to an illustrative embodiment. However, 

^^5 it will be recognized that many altemative embodiments are possible. The illustrative 

C3 embodiment involves editing a volumetric model by means of an intermediate surface 

|4f representation. The methods of the invention allow more flexible interactive editing of such 
fU . 

1^ volumetric models by supporting a wider range of standard operations, without compromising 

*P the strengths of a volumetric representation. One exemplary method consists of extracting a 
Q 

portion of the canonical volumetric representation into a surface representation, iteratively 
modifying the surface representation via a combination of mathematical and user-derived inputs, 
then merging the modified surface portion back into the volumetric model. 
[0054] The methods and systems of the invention are conveniently carried out on 

computer systems such as are described in U.S. Patent No. 6,084,587, issued to Tarr et al. on July 

25 4, 2000, and U.S. Patent No. 6,1 1 1 ,577, issued to Zilles et al. on August 29, 2000, which patents 
are incorporated herein in their entirety by reference. An example of a computer that supports 
the systems and methods of the invention is a commercially available general purpose computer, 
such as a laptop or desktop personal computer, having a central processor unit, an input device 
(such as a keyboard, a mouse, and/or a touch screen), an output device (such as a display screen, 

30 a printer, and/or a speaker), haptic input and output devices, and memory (such as semiconductor 
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memory, magnetic memory such as disks and/or tapes, optical memory, and CD-ROM and DVD 
recording and playback devices). In some embodiments, the computer operates alone, and in 
other embodiments, the computer communicates over a network. As those of skill in the 
computer arts will recognize, many different computers of many different types, operating a 
variety of operating systems, can support the systems and methods of the invention. 
[0055] Embodiments of the invention other than the illustrative embodiments of the 

invention are possible. For example, the same basic process can be applied to using a volumetric 
representation as the base representation and a b-spline or bezier representation as the alternative 
subset representation. In a further illustrative embodiment, a triangle or quadrilateral based mesh 
is used as the base representation and a volumetric representation is employed as the alternative 
subset representation. Many other alternative embodiments can be enumerated. 
[0056] In the description that follows, terms of art that are understood by practitioners of 

the mathematical and computer programming arts are frequently used. Some of these terms will 
be explained, rather than defined, in order to make more clear some of the discussion that 
follows. 

[0057] A model representation can be understood as one or more internal data structures 

that express the basic physical structure of the object being modeled. All other model properties 
can be derived from the model representation, such as for example the response of the object to a 
specified mechanical force having known magnitude, direction, and duration that is applied to a 
known location of the object. A visual representation can be understood as one or more data 
structures used to support the provision of a visual display of the object being modeled, as well 
as an example of such a visual display itself For example, in one embodiment, a visual 
representation can be the data necessary to render an image on a computer monitor or on a 
printer, and it can be the actual image so displayed or printed. A canonical representation can be 
understood as a standard model representation (e.g., a model conforming to a selected 
mathematical or logical description system) used in a particular modeling hardware and software 
system and associated method. 

[0058] As an example, a canonical representation can be a description using voxels. An 

intermediate representation can be understood as a representation in one or more data structures 
used temporarily during model modification, and as a corresponding image that can be displayed 
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by any conventional display method. A surface representation can be understood as a model 
representation consisting of an enumeration of boundary elements. In an exemplary three- 
dimensional system, a surface representation of an object can be understood as a two- 
dimensional representation of some portion of the object, such as a representation using a 
5 polygonal mesh, or a representation employing b-spline, bezier or other mathematical surface 
constructs. The surface represented can be an extemal surface or portion thereof, an intemal 
surface or portion thereof, or a combination of both types of surfaces. A volumetric 
representation can be understood as a model representation based on an enumeration of volume 
elements, such as voxels, volumetric wavelets, and the like. 
10 [0059] Figs. lA-lC are images 100, 102, 104 that illustrate various three-dimensional 

objects having surface details. Fig. 1 A is an image 100 of a physical three-dimensional sculpture 
1^ of a fish in a transparent medium, such as glass. Fig. IB is an image 102 displayed on a 
Q computer display of a computer-readable file intended to represent a hypothetical creature as it is 

being carved firom a block of a solid such as clay. Fig. IC is an image 104 of a physical three- 
-^5 dimensional sculpture of a fish in a transparent medium, such as ice. These images are presented 
IQ to provide the reader with a sense of the kind of models that can be created using prior art 
|4, technology. However, one cannot readily deform either of the physical three-dimensional objects 
represented by images 100, 104 without modifying or destroying the detail contained in them. 
Further, using prior art modeling methods, it has not been possible to modify a computer-based 

O 

|20 model such as that depicted by image 102 without severely degrading the detail in the image. In 
particular, using methods of the prior art, the digital clay medium expressed visually as image 
102 cannot be stretched, bent, warped, pulled, or otherwise modified in a msinner not consistent 
with the canonical volumetric representation.. 

[0060] The invention disclosed herein preserves the properties of prior art methods, and 

25 adds new capabilities that provide the ability to stretch, bend, warp, pull or tug, and non- 
uniformly-scale a model such as that depicted in image 102. 

[0061] Figs. 2A-2B are images 200, 202 showing a spherical object 210 represented in a 

three-dimensional volume 220 before (Fig. 2A) and after (Fig. 2B) an illustrative deformation. 
Figs. 2A-2B show an example of a process which can be termed "surface warping," in which the 
30 surface of a model is stretched without smoothing away details present on that surface. This 
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provides the ability to make relatively large, global changes to models even at a stage of model 
development where high resolution features have been applied to the surface of the model. For 
example, the system permits a model of a head to be modified by puffing out the cheeks without 
losing facial details, or in a model of an automobile, to add some bulge to wheel wells without 
5 distorting the remainder of the vehicle. This is accomplished by converting three-dimensional 
elements of a volumetric model to a surface representation, for example in a polygonal surface 
representation, manipulating the model's polygonal surface representation, and performing a 
conversion of the modified surface representation back to a three-dimensional volumetric model, 
for example by re-rasterization to instantiate the changes in the volumetric model representation. 
10 The changes can optionally be visualized by providing a visual representation at any time, 
including in real time, as the modifications are performed by a user of the system. 

[0062] Figs. 3 A-3C are drawings 300 that illustrate an embodiment of the invention 

1,3 , 

Q relating to the selecting of an area 3 10 to deform or warp (Fig. 3 A), the selection of a location 

320 at which to apply the deformation or warp (Fig. 3P), and the application of a "pulling" force 
^^5 330 to the selected area 310 at the selected location 320 (Fig. 3C). 

10 [0063] In Fig. 3A, a user of an embodiment of the system selects the surface of the model 

the user wishes to warp. In the illustrative embodiment, the user selects an area 310 using the 
^1 paint-select mechanism of a graphical user interface, which selects a surface for either warping or 
*P smoothing. The selected area 3 1 0 has a periphery 340. In Fig. 3 A, the area 3 1 0 that is selected is 
|l0 indicated by the user, who manipulates a cursor 350, such as the paintbrush shown in Fig. 3 A. 
The manipulation can be accomplished using a computer pointing device such as a mouse, by 
using designated keys, such as the right arrow, the left arrow, the up arrow, and the down arrow 
keys of a computer keyboard, by use of a touch screen^ or any other suitable method, including 
the use of a haptic interface device. 
25 [0064] The user selects (or activates) the "Waip" computer command, whereupon the 

system creates an editable mesh corresponding to the surface selected by the user in Fig. 3 A. The 
editable mesh can be generated using a polygonal, b-spline, or bezier representation, or the like. 
Optionally, in some embodiments, the selected area represented by the editable mesh can be 
identified to the user by being colored differently, or otherwise being visually distinct, so that the 
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user can observe the results of his or her modifications while the user manipulates the modeled 
object. 

[0065] In Fig. 3B, the user can "grab" a point on the selected area 310. In some 

embodiments, the user grabs the point by using a pointing device such as a mouse, and 
5 performing a "click and hold" operation with the mouse. Optionally, the location can be 
identified to the user by a cursor 350, such as the Hand Tool shown in Fig. 33. The user can 
manipulate the selected area 310, which manipulation is performed mathematically upon the 
editable mesh. For example, the user can move or drag the selected area 3 1 0 around in three- 
dimensional space, with the periphery 340 of the area 310 fixed by application of a constraint at 
10 the coordinates that exist at the time the area 3 10 is selected. 

[0066] As shown in Fig. 3C, the editable mesh "warps" to maintain a surface 345 that 

1^ starts from the periphery 340 of the selected area 310 and continues through the point 320 being 

P 

Q dragged about in three-dimensional space. 

[0067] Fig. 4 is a drawing 400 that illustrates different "falloff levels in images "a" 4 1 0 

^ J5 and "b" 420. The system may include a default value for the falloff parameter, which is invoked 
CO automatically by the system. The falloff parameter that is used to generate the surface between 

5 

1^ the selected point 320 and the periphery 340 of the selected area 3 10 is controllable by the user. 

[W For example, in the illustration, shape "a" 410 has a large rate of falloff, while shape "b" 420 has 
a smaller rate of falloff. In various embodiments, the rate of fall-off can be controlled by the user 

j|o by entry of a value, by pressing a designated key of a keyboard to increase or decrease the rate of 
falloff, or by a similar interaction with the system. When the user is satisfied with the shape of 
the editable mesh, the user presses a key or otherwise selects a menu entry that indicates that the 
then current representation of the modified area 310 is acceptable, whereupon the modeling 
system transforms the intermediate representation used in modifying the model into the 

25 corresponding portion of the model representation. In some embodiments, the system re- 
rasterizes the intermediate model into the corresponding portion of the model representation. 
[0068] Fig. 5 is a drawing 500 that illustrates the result of a directional tugging force 

applied to a selected area 310. In this illustrative example, the cursor 350, represented by the 
Hand Tool, is manipulated by the user in a direction other than along a normal to the planar 

30 surface defined by the periphery 340 of the selected area 310. The motion of the cursor 350 can 
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be linear or curvilinear. As is apparent from Fig. 5, the resulting shape of the selected area 310 is 
a peaked volume 510, such as may be obtained by dipping one's finger into a mound of shaving 
cream and pulling upward and sideward. When the user indicates that the result is satisfactory, 
the system performs the operations of transforming the intermediate representation to a model 
5 representation, as discussed with regard to Fig. 4. 

[0069] Fig. 6 is a drawing 600 that illustrates the result of applying multiple 

modifications to a selected area 310. The user can perform an operation such as is described 
with respect to Fig. 5, and can then perform a second operation, for example, by application of a 
pulling or tugging force at a new point 610. The resulting volume 620 can have characteristics 
10 that represent the first modification fiirther modified by the second modification. Because the 
modification process can be performed iteratively, it is possible to apply as many discrete 
modifications as the user of the system elects to perform. When the user indicates that the result 

Q 

O is satisfactory, the system performs the operations of transforming the intermediate 

representation to a model representation, as discussed with regard to Fig. 4. Alternatively, the 
^ j[5 intermediate representation is used to alter the model representation automatically upon each user 
ii edit. 

s 

|4« [0070] Fig. 7A is a flowchart 700 showing schematically a sequence of operations during 

model editing. In overview, an illustrative method for editing a model includes the steps of 
p generating the canonical volumetric representation, and optionally, generating a visual 
20 representation corresponding to the canonical volumetric representation. The method includes 
specifying at least a portion of the model to be modified. The specification can be performed 
manually or by automatic methods. The method includes converting the selected portion of the 
volumetric model into a surface representation. The method can optionally include updating the 
visual representation accordingly. The method includes modifying the surface representation 
25 using a combination of interactively specified user inputs and mathematical manipulation 

according to algorithmic processes encoded into the system. The method includes transforming 
the modified surface representation and incorporating the modified representation into the 
canonical volumetric representation. The method optionally includes updating the visual 
representation and optionally displaying the visual representation for the user. Each of these 
30 illustrative steps will be explained in fiirther detail below. 
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[0071] The step 710 of generating the canonical volumetric representation involves 

converting information about an object into a mathematical representation in a form expected by 

the system, which for the purposes of this discussion is the standard form. At any step in the 

process expressed by flow diagram 700, the system can optionally compute a visual 

5 representation of the object that is being modeled, and ean optionally display a corresponding 

visual representation to the user. In some embodiments, the computation of the visual 

representation is performed automatically by the system. In some embodiments, the display of 

the visual representation is performed automatically by the system. In some embodiments, the 

computation and the display are performed in response to a command from a user. 

10 [0072] The original volumetric representation can come from a variety of sources. In 

some embodiments, the volumetric representation comes from tomographic data (three- 

i"^ dimensional scans) or surface scans that have been converted into volumetric form. In some 
C3 ^ , . 

P embodiments, the volumetric representation is the output of a prior sequence of manual or 
automatic volumetric editing steps. Regardless of the process, in some embodiments, the 
^j|5 representation is a volimietric representation (e.g., a voxel grid) that enumerates the contents of 
CO the object to be modeled at every point in three-dimensional space. A visual representation is 

s 

1^ derived from the volumetric representation to allow the model to be viewed. The visual 

["J representation includes one or more data structures to support a direct rendering method such as 

«i ray casting. In some embodiments, the visual representation includes a secondary non- 

|20 volumetric derived representation, such as an isosurface. 

[0073] The step 720 of selecting or specifying of a portion of the model to be modified 

can be performed under manual control by the user or altematively can be performed by 
automatic specification by the system. A portion of the volumetric representation of the model is 
selected for modification. In different embodiments, the selection step 720 can include, but is 
25 not limited to, specification of a sub-volume using an interactively positioned tool with a region 
of influence. In one embodiment, the interactively positioned tool is a user controlled stylus, and 
the region of influence is determined by a user-controllable radius. In one embodiment, the 
position specification of a portion of the model to be modified is performed in conjunction with 
the projection of a user-positionable two-dimensional image onto the model. In one 
30 embodiment, the specification of a portion of the model to be modified is accomplished by 
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drawing a closed curve on the region to be modified, for example using a pointing device such as 
a mouse or a stylus. In some embodiments, the interactively positionable tool is a haptic 
interface device. 

[0074] The step 730 of converting the selected portion of the volumetric model into an 

5 intermediate surface representation is performed automatically by the system, using algorithmic 
mathematical manipulations. Upon specification of the portion of the model to be modified, the 
system converts the specified portion into the intermediate representation. In some 
embodiments, the selected portion of an isosurface is converted into a freely deformable 
polygonal mesh. In another embodiment, the selected portion of an isosurface is extracted into 
1 0 one or more NURBS patches. 

[0075] The step 730 optionally includes updating the visual representation at the same 

1^ time, to allow visual display during modification. For example, if modifications will be 
Q displayed by deforming an extracted polygonal mesh, the corresponding portion of the original 
%j| isosurface typically should not be displayed at the same time, in order to avoid confusing the 
U5 user. 

CQ [0076] The step 730 further includes updating the intermediate surface representation of 

1^ the selected portion of the model with a second or later selected portion. The optional visual 
representation is updated accordingly. The step 740 includes obtaining from the user an 
indication of whether more selections of portions of the model for modification are 

P 

|20 contemplated, and if so, repeating steps 720 and 730 as many times as may be required. When 

the user indicates that no additional portions of the model are intended to be modified, the system 
proceeds to making the modifications, at step 750. 

[0077] The step 750 of specifying the modification to be performed on the intermediate 

surface representation is accomplished by obtaining specifications from the user. In some 
25 embodiments, the specified modifications include pulling a portion of the surface firom its 
original location toward an interactively specified new location in three-dimensional space, 
raising or lowering the surface representation, or raising or lowering the portion of the surface 
lying within a previously specified closed curve on the model by a user-specified distance. In 
one embodiment, the user can use a two-dimensional image to specify an amount of 
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displacement. As previously indicated, constraints can be applied to the specified modification 
to limit the amount of deformation that takes place. 

[0078] The step 760 of modifying the intermediate representation can be performed using 

a combination of mathematical and interactively specified inputs. The user can interactively 
5 specify further modifications, as indicated at step 770. The user can additionally return to step 
720 to select a nev^ portion of the model to modify, or the user may continue to the next step 780. 
[0079] At step 780, the system incorporates the modified surface into the canonical 

volumetric representation and optionally updates the visual representation. After the selected 
modifications are complete, the modified portions of the surface representation are 

10 reincorporated into the canonical volume representation. In one embodiment, the canonical 

representation comprises voxels and an intermediate representation comprises a polygonal mesh. 

H In order to convert the intermediate representation into the canonical representation, the 

m 

p displaced surface is analyzed for surface crossings, which are locations where adjacent voxels lie 
!^ on opposite sides of the displaced surface. Voxels can be classified as in or out based on the 
^t5 number of such crossings they experience, and may be assigned more precise non-binary values 

by incorporating information about the distance from each voxel to the crossings that influence it. 
|4 [0080] Fig. 7B is a flowchart 702 showing schematically the organization of a system for 

three-dimensional modeling that comprises computer modules. In overview, an illustrative 
«p system for three-dimensional modeling includes modules that control the steps of a computer 
|fo modeling process. In this system, a virtual object is stored within a computer, for example in 
conjunction with a haptic interface or virtual reality environment. A representation module 705 
controls how the computer represents a virtual object as a volumetric model. A conversion 
module 715 converts some (a subset) or all of the volumetric model into an alternative model. In 
order to modify the virtual object, the virtual object is subjected to at least one stimulus. The 
25 stimulus can be applied by a user. As is understood by those of skill in the mathematical arts, a 
subset can include, as examples, the entire set, a portion of the entire set, or none of the entire set. 
[0081] An analytical module 725 determines a response of the altemative representation 

to at least one stimulus. Analytical module 725. modifies the surface representation using a 
combination of interactively specified user inputs and mathematical manipulation according to 
30 algorithmic processes encoded into the system. A modification module 735 modifies the 
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volumetric representation so as to represent the response of the alternative representation of the 
virtual object to the stimulus. Modification module 735 controls transformation of the modified 
surface representation and incorporation of the modified representation into the volumetric 
representation. In alternative embodiments, the system includes a second transformation module 
5 745 that controls the transformation of the ahemative represntation into a third representation, 
The system can also include another modification module 755 that controls the modification of 
the third representation. The system can optionally also include a transformation module 765 
that transforms the modified third representation to a modified volumetric representation. The 
system optionally includes modules that update the visual representation and optionally display 
10 the visual representation for the user, such as display module 775. Optionally, the system 

comprises a display module 775 that displays the modified alternative representation and/or the 
modified volumetric representation to a user from time to time. Optionally, the system 

C3 

Q comprises a haptic force feedback interface that applies a haptic feedback force to a user in 
%^ conjunction with a force application module 785. The system allows the user or a computer to 
^^5 specify at least a portion of the model to be modified. The specification can be performed 
10 manually or by automatic methods. Each of these illustrative modules, and the steps each module 
1^ controls, are explained in further detail below. 

[0082] The computer modules control the conversion of the selected portion of the 

»p volumetric model into an alternative representation, such as a surface representation, a set-of 
1^0 triangles representation, a polygon set, a bezier surface, a b-spline surface, a procedural surface, 
and a NURBS representation. A procedural surface is one which is expressed or defined by a 
mathematical process or procedure. For example, a procedural surface could be defined as the 
surface two units of measure above the floor of a room and two units of measure above any 
objects resting on that floor. One procedural surface results if a basketball were left on the floor, 
25 while a different procedural surface results if a roUerskate were left on the floor. Either 
procedural surface changes if the object on the floor moves. 

[0083] In the illustrative embodiment, the representation module 705 that controls or 

performs the process of representing the virtual object as a multidimensional (for example, 
volumetric) model converts information about an object into a mathematical representation in a 
30 form expected by the system, which for the purposes of this discussion is the standard form. 
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From time to time, the system can optionally compute a visual representation of the object that is 
being modeled, and c^ optionally display a corresponding visual representation to the user. In 
some embodiments, the computation of the visual representation is performed automatically by 
the system. In some embodiments, the display of the visual representation is performed 
5 automatically by the system. In some embodiments, the computation and the display are 

performed in response to a command from a user. The illustrative comments made above about 
volumetric representations apply here as well in the case of a volumetric model. 
[0084] In the illustrative embodiment, the conversion module 715 controls the selection 

or specification of a portion of the model to be modified. The selection or specification can be 
1 0 performed under manual control by the user or alternatively can be performed by automatic 

specification by the system. In one embodiment, a portion of the volumetric representation of the 
model is selected for modification. In different embodiments, the selection can include, but is 

P 

Q not liniited to, specificiation of a sub-volume using an interactively positioned tool with a region 
of influence. In one embodiment, the interactively positioned tool is a user controlled stylus, and 
^|5 the region of influence is determined by a user-controllable radius. In one embodiment, the 
(§ position specification of a portion of the model to be modified is performed in conjunction with 
1^ the projection of a user-positionable two-dimensional image onto the model. In one 
|y embodiment, the specification of a portion of the model to be modified is accomplished by 
si drawing a closed curve on the region to be modified, for example using a pointing device such as 
i|o a mouse or a stylus. In one embodiment, the uset employs a haptic interface device to designate 
the portion of the model to be modified, 

[0085] In the illustrative embodiment, the conversion module 715 converts the selected 

portion of the multi-dimensionall model, such as a volumetric model, into an intermediate 
representation, such as a surface representation.. The conversion is performed automatically by 
25 the system, using algorithmic mathematical manipulations. Upon specification of the portion of 
the model to be modified, the system converts the specified portion into the intermediate 
representation. In some embodiments, the selected portion of an isosurface is converted into a 
freely deformable polygonal mesh. In another embodiment, the selected portion of an isosurface 
is extracted into one or more NURBS patches. 
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[0086] In the illustrative embodiment, the conversion module 715 optionally includes the 

ability to update the visual representation at the same time, to allow visual display 775 during 
modification. For example, in one embodiment, if modifications will be displayed by deforming 
an extracted polygonal mesh, the corresponding portion of the original isosurface typically 
5 should not be displayed at the same time, in order to avoid confusing the user. As is understood 
in the software arts, the visual updating can be performed by invoking a module such as the 
display module 775 as a subroutine. 

[0087] In the illustrative embodiment, the conversion module 715 further includes 

updating the intermediate surface representation of the selected portion of the model with a 
10 second or later selected portion. The optional visual representation is updated accordingly. 
[0088] In the illustrative embodiment, the analytical module 725 specifies the 

modification to be performed on the intermediate surface representation. In some embodiments, 
Q the specified modifications include pulling a portion of the surface from its original location 
•-^ toward an interactively specified new location in three-dimensional space, raising or lowering the 
^ J5 surface representation, or raising or lowering the portion of the surface lying within a previously 
specified closed curve on the model by a user-specified distance. In one embodiment, the user 
can use a two-dimensional image to specify an amount of displacement. 
1^ [0089] The modification of the intermediate representation can be performed using a 

=5 combination of mathematical and interactively specified inputs. The modification can be limited 
by application of one or more constraints that limit the magnitude of a displacement of the 



model, The user can interactively specify further modifications. The user can additionally select 
a new portion of the model to modify. 

[0090] In the illustrative embodiment, the modification module 735 incorporates the 

modified surface into the volumetric representation. Optionally, display module 775 updates the 

25 visual representation. The modification module 735 can call the display module 775 as a 
subroutine. Alternatively, the display module 775 is activated by a command from the user. 
[0091] In the illustrative embodiment, after the selected modifications are complete, the 

modified portions of the surface representation are reincorporated into the volumetric 
representation. In one embodiment, the volumetric representation comprises voxels and an 

30 intermediate representation comprises a polygonal mesh. In such an embodiment, in order to 
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convert the intermediate representation into the volumetric representation, the displaced surface 
is analyzed for surface crossings, which are locations where adjacent voxels lie on opposite sides 
of the displaced surface. Voxels can be classified as in or out based on the number of such 



information about the distance from each voxel to the crossings that influence it. In general, for 
representations that involve surfaces, one can define a first side of a surface and a second side of 
a surface, or "inside" a surface and "outside" a surface. For objects that are volumes, one can 
define modifications that preserve the volimie while changing a shape of the volume. 
Alternatively, one can define modifications in which the volume increases, or modifications in 
which the volume decreases. 

[0092] As will be appreciated by those of skill in the software arts, the various modules 

can often be used repeatedly in any one session. As indicated in Fig. 7B, the system can allow a 
user to complete a modification of a representation, and can then retum to the conversion module 
715 in order to select a fiirther subset or portion of the model for fiirther modification. As will be 
appreciated by those of skill in the software arts, a module that embodies a particular set of 
instructions that perform a specific logical operation or group of operations often can be 
duplicated in hard- wired circuitry,or in a combination of software and hard-wired circuitry, in a 
manner which is completely transparent to a user. In some embodiments, one or more modules 
can be provided in hard-wired form or can be provided as a pre-programmed chip in order to 
assure that a particular instruction or set of instructions is performed in the same marmer, 
independent of user input or user manipulation. As will be appreciated by those of skill in the 
software arts, it is often possible to write more than one computer program module to perform 
the same one task when operating, or to write a module in any one of several programming 
languages such that the module, when operating, performs substantially the same steps, or 
performs substantially equivalent steps, to attain a particular result. All such variants are 
contemplated herein. 

[0093] Fig. 8 is a schematic diagram 800 showing illustrative transformations of a 

modified portion of a model fi-om canonical to intermediate representation and back, with editing 
done in the intermediate representation. In Fig. 8, a canonical volumetric representation 801 of 
an object is provided. A bounding box 81 1 indicates a region of the representation 801 has been 



crossings they experience, and may be assigned more precise non-binary values by incorporating 
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selected for modification. The region in the bounding box 81 1 is expressed in an intermediate 
sxu"face representation 802. In this illustrative example, the user specifies one or more 
modifications of the object that cause the transformation of representation 802 to the modified 
intermediate surface representation 803. When the user is satisfied with the transformations, the 
5 system converts the modified intermediate surface representation 803 into the modified 

volumetric representation 804. The system optionally computes and optionally displays visual 
representations corresponding to representations 801, 802, 803, and 804 for the convenience of 
the user. 

[0094] Fig. 9 is a diagram 900 showing an embodiment of an illustrative rasterization 

10 process based on surface crossings for conversion of a model fi-om a surface representation to a 
volumetric representation. Fig. 9 depicts a cross section through a surface representation 
superimposed on a grid of voxels defined on a square lattice. The curvilinear line 930 denotes 

Q 

Q the locus of points that represent the surface representation. After application of a 

transformation, some of the points 910, shown in filled circles, fall to one side of the surface. 

^^5 Other points 920 lie on the other side of the surface. The system can then compute the required 

13 three-dimensional values for representing the appropriate volume in the three-dimensional 

1^ canonical representation, for modification of a modeled object. 

[0095] Fig. 10 is an image 1000 of an embodiment of a menu in a computer user interface 

that provides access to modeling features. In the illustrative system, a computer user interface 

1^0 having a "look and feel" similar to one or more of the well-known Windows™ (Windows™ is a 
trademark of the Microsoft Corporation, Redmond, Washington, USA) applications is depicted. 
In other embodiments, user interfaces of different types, having a different "look and feel," are 
possible, as will be appreciated by those of ordinary skill in the computer programming arts. The 
illustrative interface has a menu item denoted by the term "Tools" 1010. A subcategory of tools 

25 is denoted by "Special Effects" 1020. Individual special effects are indicated by the menu items 

' t * 

"Tug" 1030, which will be described in greater detail below, and by "Spikes" 1040. As those of 
ordinary skill in the computer arts understand, the user can invoke an individual special effect by 

successively activating the sequence of items Tools 1010, Special Effects 1020, Tug 1030 using a 
pointing device such as a mouse, a touch pad, a touch screen, or a light pen, or by issuing the 
30 sequence of keyboard commands Control-T (<CTRL>-T), Control-E, and Control-T, based on 
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the underscored letter of the corresponding command;- When a user has issued the appropriate 



as described above. In one embodiment, this brings the system into a mode where a cursor 350 
normally represented by an icon having the shape of a hand is replaced with a transparent clay- 
colored sphere with a red center point. The cursor display indicates to the user that the "Tug" 
functionality is active, and can show the user the effects that commands issued by the user will 
have on the object that is being modeled. 

[0097] The sphere indicates the region of the model that will be modified using a falloff 

function centered at the red point. The default falloff function may be determined empirically. 
In one embodiment, the curve that is implemented is essentially a bell curve. It is chosen 
because it provides an esthetically pleasing taper to the edge of a selected region and multiple tug 
operations can be performed with good resolution in the valley that results between successive 
tug operations, as indicated previously in conjunction with Fig. 6. 

[0098] In operation, the user places the sphere on the model, thereby selecting a region to 

modify, and then holds the button on a haptic feedback system stylus to activate the tug 
operation, and modifies the model by applying tugs to the clay. The system provides a spring 
force to help control the placement of the sphere. The surface model updates in real-time. When 
the stylus button is released, the modified polygons stay in their then-current positions. The 
visual representation is updated to provide visual feedback to the user in real time. The user can 
continue to modify the surface by repeating the sequence of commands. 

[0099] Fig. 1 1 is an image 1 100 of an embodiment of a control panel that allows a user to 

control the operation of modeling features of the Tug functionality. Image 1 100 is a software 
control called a dynabar. The dynabar 1 100 includes a button 1110 labeled "Nudge," a text box 
1 120 in which the user can enter numerical values, an increment arrow 1 130 and a decrement 
arrow 1 140 that can be used to modify the value in text box 1 120, a button 1 150 labeled "Done" 
that permits the user to accept the effects of one or more modifications, and a button 1 160 
labeled "Reset" that cancels all modifications since the latest action selected from the group 
consisting of invoking the tug functionality and activating the "Done" button 1 150. 



commands, the Tug functionality of the system is activated, and the user is presented with an 
instance of illustrative Fig. 1 1 . 

[0096] "Tug" is an effect that is accessed through the Tools->Special Effects->Tug menu 
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[00100] When the user issues the "Done" command, the model is re-rasterized to 
incorporate any changes that have been made. If no changes have been made or the model has 
been reset or all changes have been undone, the button is unavailable, e.g., it is displayed in a 
"grayed-out" visual representation. Activation of the Done button 1 150 does not cause the Tug 
5 functionality to terminate. 

[00101] The Reset button 1 160 undoes all changes that have been made since entering the 
tug environment or since the last "Done" command. It is unavailable when the "Done" 
command is xmavailable. 

[00102] The diameter of the sphere can be changed through a text field within a range of 
10 values having the current dimensional imits, through use of the increment and decrement arrow 
buttons 1130, 1 140, or continuous tool resize using a selected keyboard key, such as the "[" key. 

H The Reset button 1 160 undoes all of the changes to the surface model. The Nudge button 1110 

O 

P attenuates the motion of the surface model to aid in making precise changes. The operation of 

; J the Nudge button 1 1 10 is more fully described in the U.S. provisional patent application Serial 

1*5 No. 60/255,530, further identified by Attorney Docket No. SNS-009PR, filed December 14, 



2000, entitled "Systems and Methods for Three-Dimensional Modelling." Activation of the 
Done button 1 150 incorporates the changes into the model. 



f U [00103] Fig. 12 is a graph 1200 that illustrates an embodiment of a single valued- 

distribution function f(G)) 1210 that maps the interval [0,1] along the horizontal axis 1220 as a 1- 



1^ to-1 mapping onto the interval [0,1] along the vertical axis 1230. A single-valued function is one 
that has a single dependent value y for each discrete independent value x. In one embodiment, 
the function can be a sigmoidal function as shown in Fig. 12. 

[00104] Figs. 13A-13B are graphs 1300, 1302 that illustrate various relationships between 
a source point S 1310 and a point Po 1320 that the point S can influence. 
25 [00105] In one embodiment, the system can perform smoothing without losing details that 
exist in a model. The smoothing operation produces locally fair surfaces. This new operation 
also can be used to repair and /or clean up input files for editing. 

[00106] The following is a high level description of the algorithm. Following this is one 
approach to implementation and some concluding remarks. The algorithm uses as inputs a 
30 closed boundary on the isosurface of the model, a complexity factor that establishes the baseline 
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for the desired result of smoothing, a smoothing factor in [0,1] that establishes the amount of 

desired smoothing for the target patch calculated from the initial patch, and a fall-off function 

that allows the smoothing effect to gradually taper to zero at the initial patch boundary. 

[00107] In some embodiments, the closed boundary on the isosurface of the model is a 

5 four-sided patch boundary. In alternative embodiments, the closed boundary is an arbitrarily 

shaped region. The isosurface triangle data within the boundary is referred to as the initial patch. 

[00108] In some embodiments, the complexity factor that establishes the baseline for the 

desired result of smoothing is in [0,1] where 0 indicates the initial patch contains little surface 

detail to be modeled and 1 indicates the initial patch has a lot of surface detail to be modeled. 

10 [00109] In some embodiments, the smoothing factor is in [0,1] that establishes the amount 

of desired smoothing for the target patch calculated from the initial patch. A factor of 0 indicates 

M' no smoothing and a value of 1 indicates maximal smoothing. 
C3 

{3 [00110] In some embodiments, the fall-off function that allows the smoothing effect to 

•a J gradually taper at the initial patch boundary is described as a factor in [0,1] where 0 indicates no 

S'tS fall-off and 1 indicates a maximum default fall-off. In other embodiments, this fall-off function 

f 1^ is an arbitrarily shaped, force-based function applied to the isosurface. 

s 

[00111] The command issued by a user includes defining the boundary and interactively 
[U and iteratively adjusting the complexity factor, the smoothing factor, and the fall-off function 

until the resulting output is satisfactory. In one embodiment, the boundary is defined by 
||o interactive tracing on the surface. 

[00112] In some embodiments, the complexity factor is adjusted much less frequently than 
the smoothing factor and fall-off function. In one embodiment, these controls are simple sliders. 
After each change, the user is shown a simulation of the result that will be achieved if the 
operation is executed. In alternative embodiments, the conmiand provides "before-and-after" 
25 control for assessing the visual change. : 

[00113] In one embodiment, after the boundary is established and a complexity factor is 
given, or each time the complexity factor changes, the algorithm models the initial patch with 
two mathematical descriptions, including a baseline surface model and a displacement map in the 
u-v unit square. 
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[00114] The baseline surface model is a mathematical interpolation of the triangle vertices. 
A known approach to such surface fitting problems is thie use of least-squares fits to NURBS 
surfaces. The baseline surface is then a parametric definition S(u,v) where u,v e [0,1]. The 
number of control points defining S is established by the complexity factor. In order to achieve a 
5 good surface fit, a set of well-behaved isocurves is generated along the initial patch, and the 

isocurve intersections become the targets of the interpolation. This set of intersections is referred 
to as the baseline grid. 

[00115] In one embodiment, the displacement map in the u-v unit square tracks the "error" 
between the initial patch and the baseline surface model. This displacement map is referred to as 
1 0 the three-dimensional vector valued function D(u,v). 

[00116] Within computational round-off error, each point of the baseline grid should equal 
S(u,v) + D(u,v) for the (u,v) coordinates that correspond to that grid point. That is, if 0(u,v) 



P represents the original triangle data at the baseline grid values, we then have: 
^ 0(ui,Vj) » S(ui,Vj) + D(ui,Vj) 

■15 at the baseline grid points (ui,Vj). 



[00117] In one embodiment, the original patch is modeled as a smooth and fair (with 



|4, moderate to low complexity factor) surface plus the bumps that occur on it. 

1^ [00118] The fall-off function is a scalar-valued function f(u,v) € [0,1]. In one 



embodiment, the user provides a 1 -dimensional input to generate f A user value of 0 (no fall- 
|30 off) establishes f(u,v) = 1 for all u,v. A user value of 1 (maximum default fall-off) establishes 

f(u,v) = 1 for all u,v within the "center" of the u-v unit square and functional values feathering to 
0 at the edges of the square. This feathering is a known two-dimensional imaging technique and 
is facilitated by the two-dimensional nature of the u-v parametric space. 
[00119] Referring to the smoothing factor as s, we calculate a target surface (T(u,v)) as: 
25 T(u,v) = (1 - f(u,v)) 0(u,v) + f(u,v) [S(u,v) + (1-s) D(u,v)] 

when s = 1 (maximum smoothing), T(u,v) = S(u,v) when f(u,v) = 1 (target surface is original 
"wrapped" to baseline surface model), and T(u,y) = 0(u,v)when f(u,v) = 0 (target is original at 
the feathered edge). As s approaches 0 (minimum smoothing), T(u,v) approaches 0(u,v) 
regardless of f(u,v). In one embodiment, the surface described by T(u,v) is then re-rasterized 
30 back into the canonical model, which is a voxel model. 
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[00120] The algorithm is implemented by performing the steps of tracing the outline on 
the isosurface, determining a baseline grid, interpolating to find S(u,v), calculating D(u,v), 
calculating f(u,v), calculating T(u,v), and re-rasterizing the result for incorporation into the 
canonical model. 

[00121] The surface tug algorithm can be expressed as follows. In one embodiment, there 
is defined a point to influence Pq 1320, Pq = (xq, yo, Zo), a range of influence D, D = (xd, yd, Zd), a 
radius of influence r 1330, and a single valued-distribution fimction f(a)) that maps the interval 
[0,1] as a 1-to-l mapping onto the interval [0,1]. See, for example. Figs. 12, 13 A, and 13B. 
[00122] For any source point S 1 3 1 0, given by S = (xs, ys, Zs), find a target point T, given 
by T = (zt, yt, zO such that: if S = Pq, then T = Po +D, and if S is on or outside a sphere of radius r 
with center at Po, then T = S (i.e., there is no change in S). In one embodiment, the effect within 
the sphere falls off with a "tapered" shape (i.e., the effect increases the closer one gets to Pq). 
[00123] Another feature of the algorithm is expressed as follows: 



Leta= II S-Po 



(representing distance squared) 
In case 1 (see Fig. 13A): 



a > r^ => S is unchanged, or T = S. 



In case 2 (see Fig. 133): 

; a<r^ 
Let p = a = distance fi-om S to Pq 
and y 1340 = p/r = distance normalized to the interval [0,1] 
Then let 

T = S+f(l-Y)D 
Since f(l) = 1 , T = Pq + D when y = 0. (This implies S = Po) 

[00124] In different embodiments, f(Q)) will change for various effects and could be a 
discrete curve interpolated fi*om any co in [0,1]. 

In various embodiments, there are options for smoothing and related surface 
manipulation. One embodiment involves space warping. In some embodiments this can be 
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accomplished using methods for moving a surface. In one embodiment, vertices are pushed. 
Such a method can involve resampling of polygons if high curvature exists, and does not prevent 
foldover. In one embodiment, volumes are resampled. This approach maintains valid volumes. 
[00125] In one embodiment, a front propagates. This embodiment is a hybrid between a 
vertex-based method and a volumetric method. It is yolumetric over a limited domain. Other 
embodiments involve warping by use of three-dimensional control points, such as a matrix or tri- 
cubic representation. Still other embodiments involve warping by use of a proxy object such as a 
point, a space curve, a polynomial expression, or the like. 

[00126] While the invention has been particularly shown and described v^th reference to 
specific preferred embodiments, it should be understood by those skilled in the art that various 
changes in form and detail may be made therein without departing from the spirit and scope of 
the invention as defined by the appended claims. 
[00127] What is claimed is: 



